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methods as listening to conversations on street corners, in taverns, and
at sporting events; asking questions informally; counting the number
and types of people doing certain things (praying in public, attending
brutal sports events); collecting spontaneous essays, diaries, etc.
These procedures have certain features to commend them: direct
observation, freedom from verbal concealment. On the other hand,
many will be displeased with the idea of deliberate eavesdropping, as
the main method might be described. It is even more distressing, to
those familiar with the pitfalls of public-opinion study, to note how
casually the problems of stratified sampling, question phrasing, and
other controls have been approached.
As far as the United States is concerned, it seems safe to predict
that the development of polling will continue along lines already laid
down: interviews rather than mail ballots; improved stratified sam-
pling; formal rather than open-end questions, except for special studies;
continuous statistical analysis to ensure that the obtained results are,
the most reliable possible.
VALIDITY
We can check the results of one poll against another, or of one type
of question against another, to see that the answers agree. This is a
measure of the extent to which the surveys are reliable. But one might
still ask, "Do people act that way? Are the results valid?"
It could be argued that, if a person says he dislikes Communism,
that is automatically a valid index of his personal opinion, since we
cannot go behind his statement. But, as has been found since V-E
Day in Germany, the most ardent Fascist can say he always disliked
Fascism. The validity of a remark, therefore, ought to be measured
by checking it against action.
In so far as voting is concerned, the validity of the scientific polls
is amply proved. The margin of error on recent elections Has been
very small. It appears that, if a person says he is going to vote
Democratic, or Republican, or Socialist, this can be accepted as a
valid datum. There are still a certain number who prefer to say,
''Undecided/' but they constitute a sufficiently small group that they
do not upset most poll predictions.
On issues where personal prestige might be involved (opinions
about which emotion is quite strong), the findings are not so satis-
factory. Schanck1 reported that his subjects gave quite different
opinions, speaking as private citizens, from those they put forth when
1 Schanck, R. L., Study of a Community and Its Groups and Institutions Con-
ceived of as Behaviors of Individuals, Psychol Monogr., 1932, No. 195.